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A  one-sided  analog  of  Kolmogorov's  inequality,  j 

|  Albert  W.  Marshall  12  I 


A  one-sided  inequality  of  the  Chebyshev  type, 
Albert  W.  Marshall  and  Ingram  Olkin 


PREFACE 


In  cany  applications  one  is  frequently  confronted  with  the  problem 
of  obtaining  a  bound  for  the  probability  that  a  random  vector  falls  in 
a  certain  region.  Alternatively,  the  bound  nay  be  specified  and  one 
nay  want  to  define  the  limits  of  the  region.  This  report  13  concerned 
with  the  theoretical  development  of  two  such  bounds,  and  we  now  give 
several  examples  which  illustrate  the  use  of  the  results. 


1.  MULTIPLE  DECISION  PROCEDURES;  SLIPPAGE  PROBLEMS. 

Several  authors  have  considered  these  problems,  e.g.,  Bechhofer, 

Dunnett,  and  Sobei;  Paulson;  Karlin  and  Truax.  For  this  situation  we 

have  a  random  vector'  t  *  ( where  each  t^  has  a  student's 

t-distribution.  However,  the  are  correlated  because  the  estimate 

of  varir^nce  is  the  same  in  each  In  choosing  the  population  with 

the  largest  mean  or  In  deciding  whether  the  mean  in  one  of  several 

populations  ha3  slipped,  the  relevant  statistic  is  max  t  . 

1  <  J  <  Jt  J 

Thus  one  requires  information  about  P  [max  t  >  c]  <  cc  .  In  this  case 
one  may  desire  the  value  of  a  if  c  is  given,  or  the  value  of  c  if 
a  is  given. 

Since  the  Joint  distribution  of  the  t^  is  known,  one  might  hope 
to  obtain  more  accurate  bounds  for  max  t^.  However  the  distribution  of 
max  t,  is  not  eaoily  determined  so  that  Chebyshev  type  bounds  can  be  used 
as  an  approximation. 
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Some  typical  problems  where  this  arises  are : 

(i)  The  determination  of  which  of  several  types  of  alloys 
will  produce  the  highest  mean  tensile  strength, 

(ii)  the  determination  of  which  of  several  drugs  p'roduces 
the  greatest  mean  effect, 

(iii)  the  determination  of  which  of  several  lots  of  projectiles 
will  produce  the  longest  mean  range. 

2.  ANALYSIS  OF  VARIANCE. 

A  parallel  situation  to  1  prevails  in  some  types  of  analysis  of 
variance  problems.  Here  we  have  a  random  vector  F  =  (?  ,  ...,F,  ),  where 

x  £ 

each  F^  has  an  F-distribution,  but  the  F^  are  correlated.  Again  the 

relevant  statistic  is  max  F  .  Some  tables  for  small  values  of 

1  <  J  <  k  J 
k  have  been  given  by  Ramachandran . 

3.  PHYCHOLOGICAL  TESTING. 


In  certain  testing  problems  there  may  be  a  number  of  tests  which  in 

some  sense  increase  in  difficulty.  For  example,  an  ordering  cn  difficulty 

might  be  addition,  multiplication,  calculus.  Following  a  model  of  Guttman, 

the  score  on  test  one  is  given  by  y^,  the  score  on  test  two  by  y,  +  y^, 

and  the  score  on  test  J  by  y^  +  •<•+  yj.  Thus  the  .’ncrease  in  difficulty 

from  test  J  to  test  J+l  is  represented  by  y  .  Given  various 

J+i. 

assumptions  on  the  y's,  one  is  Interested  in  some  personnel  assignment 

problems  in  finding  a  bound  for  the  Pj  max  (y  +  ...  +  y  )  >  c 

4.  <  J  <  k  1  J 

(til) 


A  ONE-SIDED  INEQUALITY  0?  THE  CHE3YSHEV  TYPE 


by 

Albert  W.  Marshall  and.  Ingram  Olkir.-^ 

0.  Summary.  Let  x  =  (x^y*,x^)  be  a  random  vector  vith  Ex^  =  0  and 
either  (i)  EXj2  =  cr2  ,  Ex^  =  e2p  (i^j)  ,  t,J  =  l,'",k  ,  or 
(li)  Ex,2  =  o^2  ,  i  =  l,***,k  .  In  each  case  a  sharp  upper  bound  (only 
involving  the  specified  moments)  for  ?(x1  >1  or  •••or  x,  >  1)  is 
obtained.  A  formulation  for  more  general  one-sided  bounds  is  also  discussed. 

1.  Introduction:  Let  x  be  a  random  variable  with  mean  0  and  variance 
o 

a  .  Then  according  to  Chebyshev's  inequality, 

(1.1)  P(M>1)<V2; 

the  corresponding  one-sided  Inequality 

(1.2)  P(x  >  1]  <  ff2/(o2  +  1) 

is  also  known  (see  e.g.{2,p.l9Q]) •  Both  inequalities  are  sharp. 

A  generalization  of.  inequality  (l.l)  was  obtained  by  Clkir.  and  Pratt  (l ] 

o  o 

for  P(|x1|  >1  or  •••  |x^|  >  1)  in  the  case  Sx^  =  0  ,  Ex^  =  c"  , 

p 

Ex.x.  3  ff  o  (i  i  j)  ,  i,J  a  l,***,k  .  We  are  concerned  here  with  the 

*  J 

corroi.por.ding  bound  for  P{xeT)  a  P(x.  >1  or  •••  or  x.  >  1}  . 

y  On  leave  of  absence  from  .Michigan  State  University.  This  research  -was 
aponsored  in  pa.-;  by  the  Office  of  Ordnance  Research. 


Consider  a  real-valued  function  f(x)  =  f(x. ,  ■  •  •  ,x,  )  such  that 

X  iC 


f(x)  >0  for  ail  x  ,  f(x)  >  1  for  x  €  T  ; 


S  f(x)  >  /  f(x)dP  >  P(xsT)  . 

(xeT) 


Since  we  wish  the  bound  to  be  a  function  of  tne  covariance  matrix 


£  =  (a  )  ,  we  choose 
^0 


f(x)  =  (x-a)  A  (x-a)'  , 


where  a  =  (a^,**-,^)  ,  A  a  (a^)  :  k  x  k  .  A  "best"  bound  is  one  which 
minimizes 


3  f(x)  =  tr  A(£  +  a'a)  , 


subject  to  (1.3)  •  Let  z  =  (x-a)  D  ,  where  P  a  diag  (1-a, ,  •  •  •  ,1-a.  ) 

i-o  1-a  -  * 

and  let  A  a  D  AD  .  Since  f(a)  =  0,  (1-3)  implies  that  a  /  T  , 

1-a  1-a  i 

I 

i.e.  a  <1  ,  la  l,***,K  .  Thus  (1.3)  becomes  1 

**  t 


(1.7)  z  A  z'  >  0  for  all  z,  z  A  z '  >  1  if  some  z.  >  1  . 


By  the  results  of  (1)  the  bound  (1.6)  will  be  minimized  by  a  positive 


v 


-3- 


-*  +  -1 
definite  matrix  A  (or  in  turn  A)  for  vhich  B  =  (A  )  has  ones  on  the 

main  diagonal.  Thun  the  problem  has  been  transformed  to  that  of  minimizing 


(1.8) 


tr  A(£  +  a'a) 


-1  -1  .  .  -1 
tr  B  D  (£  +  a'a)  D 

1-a  1-a 


for  <  1  and  B  =  (b^)  positive  definite  with  b^  *  1  ,  1  =  l,***,k  . 
Any  such  a  and  B  will  yield  a  valid  bound  which  in  general  will  not  be 
sharp. 

The  problem  of  finding  a  sharp  bound  has  not  been  solved  for  general 

covariance  matrices  even  when  k  *  2  .  We  give  a  solution  for  the  case  that 
P  P 

*  a  ,  *  a-  p  (i/j)  ,  and  an  example  which  attains  equality  in 

Sections  2  and  3 .  In  Section  4  ve  give  a  sharp  bound  which  only  Involves 
the  variances. 

Ve  will  frequently  encounter  a  class  sr  of  positive  definite  matrices 
A*  (6^)  with  *  1  >  5£j  3  &(Mj)  •  Then  &  can  he  written  as 


(1.9) 


A  »  (1-5)  I  +  5  e'e  , 


where  e  -  (1, *•*,1)  .  Such  a  matrix  may  be  transformed  to  diagonal  form 
by  an  orthogonal  matrix  T  ,  whose  first  row  is  e/7k  ,  i.e. 


(1.10) 


TAP  *  (1-5)  1  +  6  Te'eT 

r.  (1-5)  1  +  6  (i/k,  0,  •  •  •  ,0) 1  (v'k,  0,---,0) 
*  d lag  tl+(k-l)5  ,  1-5, * • ’ ,1-6)  . 


<  &  <  1  . 


Hence  A  is  positive  definite  if  and  only  if  (fc-l)'1 

2.  Derivation  of  the  bound:  If  £  e  £  ,  then  because  of  synmstry  ve 
suspect  that  the  minimizing  3  =  (l-b)l  *  be*e  «  £)  and  a  =  Ge  .  In 
any  event,  we  may  find  the  best  hound  obtainable  from  such  3  and  a  , 
and  an  example  of  sharpness  would  justify  the  choice. 

3y  using  (1.10)  and  assuming  a  *  ere  ,  3  e  JD  ,  the  bound  (1.8)  can 
be  written  in  the  fora 


H(a,b)  =.  (l-a)"2  tr  B'^E  +  a2  e’  e) 


(l-a)”3tr  (rBr1)*1  (rir*  +  a2  re'er' 


Since  r  Sr'sdiag(l+(k-l)b,  1-fc,  •  • 1-b),  f  E  r’=c?  dicg(U(:t-l}p,  l-~,  ...,i-P) 
and  eP  =  (VST  ,0, -*-,0)  ,  so  that 


(2-1)  K(u,b)  = 


(l-a)‘ 


j2t  o2u(k-I)  -ra2k  ,  tf2(k-l)(i-0)  ! 
l+(k-l}b  +  - ~ - 1 


1-b 


a  k[ct2+  q2+  b(g2fc  -  a2)  1 

(l-a)2(i-b)(u(k-i)b] 


■'here 


[2.2) 


t  =  (k-l) (l-o)  -  1  . 


•  V 


^  ■ 


’  r  .  | 


The  solution  of  dH/5a  =•  0  for  a  is  given  by 


(2.3)  ao  =  -A l+bt)/(l-b)  , 


from  which 


(2.U)  H(aQ,b)  =■  k  <r2(l‘bt)[l+(k-l)b]  1  (lwr2-b  (l-a2t)l  1 


The  equation  SH(aQ,b)/3b  =  0  becomes 


<2  o; 


i)2t{l-(72t)  +  2b(l-e2t)  -  (cr2->-p)  *  o  , 


and  has  roots 


(2.6)  b  = 


1  /lt-to  1  .  /(1+tMk-l-t) 

.  -  -  -  a  -  t  i  - 


t/l-<72t 


t/(k-l)(l-a2t) 


Using  (1.10)  ,  we  see  that  the  term  1+tp  (l-p)(lt-(k-l)ol  >0 
and  we  assume  that  l-cr^t  >  0,  so  that  the  roots  are  real. 

B  is  positive  definite  if  and  only  if  -(k-l)"1  <  b  <  1  ,  i.e. 


(C.7) 


k-l-t  „  /(l+t)(k-l-t)  _  1+t 

MiTT)  -  *  r—  -o-  -  ~ 

t/(M)(l-a“t) 


If  t  >0  (t  <  0)  ,  then  the  IJSS  x.d  RHS  are  positive  (negative), 


v-  l 


'  V  ' 


.  ■■‘.I  _ _  ,~~C  . 


■;? 
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and  the  lower  sign  is  impossible.  Ve  denote  by  bQ  the  root  with  the  positive 
sign,  and  by  Bq  the  corresponding  matrix. 

Lemma:  Bq  is  positive  definite  if  and  only  if 

(2.8)  k  >  a2(k-l)(l+t)  . 

Proof:  The  condition  that  be  positive  definite  is  equivalent  to 

the  inequality  (2.7)  with  the  plus  sign.  The  second  inequality  is  (2.8), 
and  the  first  inequality  always  holds.  !| 

An  example  of  sharpness  will  show  that  bQ  leads  to  a  minimum.  We 
assume  (2.8)  and  evaluate  H(ao,bQ)  by  showing  (using  (2.6))  that 

ka2(l-tb  t) 

(2.9)  H(a  ,b  )  -  - 1 - - - 

0  0  (l+(k-l)boHl«  -b0(l-cr2t)l 

_ ka2t _ 

{k-2+ta2+o2(k-l)]  -  2b.(k-l)(l-a2t) 


Then  substituting  for  b^  ,  we  obtain 

(2.10)  H(ao,bQ)  *  kff2t/(u-2vv)  , 

wh ere  u«  t2j2  +  t(k-2-(k-l)cr2)  2(k-l)  ,  and  v  -  ( lu)(k-l-t)(k-i){  l-o2t) 


Rationalisation  of  the  denominator  in  (2.10)  ar.d  simplification  yields 


^  r-?,  *£?  £SfX^«J$n  tfm 


-7- 


s 

t<t 


x 

* 


(2.11) 


H(VV  •  g 

[ta2-k-<r2(k-l)r 


After  substituting  for  t  frca  (2.2)  ve  obtain  the  theorea. 

o  2  2  , 

Theorea:  Let  x  be  a  rar.dcs  vector  with  Ex^-O,  Ex  f  =  cr  ,  2  x  =>cr  o(i?j) 
If  (i)  l-a2t  >  0,  (ii)  k  >  cr2(k-l)(l+t)  ,  then 


(2.12)  P  3  p(x^  >  1  or  ***  or  ^  >  1)  <  H(ao,bQ) 


:<g2(/[U(k-l)olfl-HT2-g2(k-l)(l-p)]  +  (k-l)/l-p)2  . 

(k  +  n2[l+( k-i)p]}2 

otherwise  P  <  1  . 

For  the  special  case  o  =  1  ,  the  inequality  reduces  to  (1.2),  and  for 
p  a  -l/(X-l)  ,  the  bound  is  (k-l)a2  ,  which  reduces  to  (l.l)  for  k  =*  2  . 
It  should  be  noted  that  the  bound  H(ao,bQ)  <1  is  equivalent  tc 


(a2(k-l)/(l-p)(l+(k-i;p]  -  k  /l+a2-g2(k-l)(l-p))2  >  0 

3.  Sharpness:  Ve  show  sharpness  of  (2.i2)  by  exhibiting  an  example  which 
achieves  equality  whenever  the  conditions  (i)  and  (ii)  of  the  theorea  are 
satisfied.  For  rases  that  the  theorea  provides  only  the  trivial  bound  ituitv. 
we  give  examples  when  k  »  2  . 

Let  z  be  a  random  vector  with  the  ioliowir.g  distribution: 


■V***"*1* V>**V*+K.K*f*<*~—* 


"rri.n?*-4-. 


<  ***£»'<* 


.  y.  ‘  > 

Sfeob&fesftr’-' 


»  • 
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?{z  =  b^)  =  p/k  ,  1  a  1,  , 

PU  =  0)  =  1-p  , 


•where  b^  is  the  i-th  rov  of  3  .  If  x=  (I- a  )z+a  e  satisfies 

O  0  0 

the  conditions  of  the  theorem,  then 


(3-1)  2(z)  =  -  aQe/(l-ao)  =  [l  +  (k-l)bo]p  e/'k  , 

(3-2)  2(z’z)  =  (£  +a2  e’e)/(l-ao)2  =  ?  32/k  . 

Substituting  for  clq  frees  (2.3)  is  (3.1)  and  solving  for  p  ,  we  obtain 
p  *  H(aQ, b^)  ,  where  H(aQ,bQ)  is  given  by  (2-9)-  3ecause  of  the  special 
fom  of  £  ,  th"  efttrix  --quation  (3-2)  is  equivalent  to  the  two  equations 

(3-3)  [(i-bc)2  +2bo(i-bo)  +  b2k)  p/k  =  (c2  +  a2)/(l-ao)2  , 

(3-~)  (2bo(l-bo)  +  b2  k  )  p/k  =  (o2o  +  a2)/(l- On)2  . 


Substitution  of  p  and  aQ  fro=  (2-3)  in  (3.3)  and  in  (3.3)  ssinus  (3.14) 
yieins  (2.5)  vit.n  b  =  bQ  in  each  case.  Hence  (3-1)  and  (3*2)  are  satis¬ 
fied  when  p  -  ,  that  is,  when  p  is  given  by  the  bound  of  (2.12). 

Since  ?fz1  >  1  for  soze  i)  =  p  ,  and  ^  >  1  if  and  only  if  x,  >  1  ,  it 
follows  that  x  =  (l-cro)z+aoe  achieves  e quality  in  ',2.12). 


-9- 


Hov  suppose  that  k  =  2  ,  in  which  case  conditions  (i)  ar.d  (ii)  become 
2  2 

1  +  cr  o  >0,  and  2  >  a  (l-  p)  ,  respectively. 

2 

If  1  +  cr  p  <  0  ,  then  a  distribution  having  the  prescribed  moments  and 
achieving  the  bound  of  one  ie: 

P((l,-c)]  =  ?((-c,l))  =  px/2  , 

?{(c,-c)}  =  P((-c,c)}  =  p2/2  , 

PC  (i,  1)1  =  l  -  px  -  P2  , 

where  p]L=  2c2(l+p)/(c2-l) ,  p2=  (l+u2p)/(l-c2) ,  c  =  |  j^(l+p)+/[o4(l+p)2+^a2]  j- 

2  s> 

The  condition  i  +  a  p  <0  iinpiica  that  :*  >  1  and  c  >  1  .  Hence  0  < 

P1  +  P2  -  1  * 

2  2 

If  2  <"  c  (l-p)  and  1  +  a  p>  0  ,  then  a  distribution  with  the  moments 
as  prescribed  in  the  theorem  and  achieving  the  bound  of  one  is: 


where 


P({l,-c)l  3  P((-c,l))  *  p/2  *  P((d,d))  »  1-p  , 


2d  2g  (1-p) 

2d+c-l  =  v2 

(1^) 


h/(l-p2)(l+g 


o) 


(c  *  c2/2  if  p  *  o)  .  The  condition  2  <  o2(l*p)  implies  that  c  >  1  , 

p 

which  in  turn  Implies  that  p  <  1  .  It  also  implies  1+c  <  c  (1-p)  which 
is  equivalent  to  d  *  p(c-l)/2(l-p)  >  1  . 


h'i- 


•***» «* «  t  i  r rr»  iv  rwi 


^**"1 
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2  2 
If  1  +  a  p  a  0  ,  then  the  above  distribution  vith  d  »  1  ,  c  =  <3  , 

o 

p  =  2/(1  +  3  )  is  the  required  example . 


4.  An  inequality  involving  variances .  If  x^,***,^  are  randon  variables 


with 


2xi  =  0  ,  Ex^  =  a2  ,  i  =  1,  •••,k  ,  then  by  (l.l) 


(U.l)  ?{|x  |  >  1  or  •••  or  |x  |  >  1}  <TT?{|x  {  >  D  <  JZ  A 


This  inequality  was  proved  to  be  sharp  in  (i],  and  the  unique  distribution 
attaining  equality  has  zero  covariances. 

The  corresponding  one-sided  inequality,  by  (1.2),  is 

(4.2)  PfXj.  >1  or  ...  or  >  1)  <  2Z  ?(xj  >  D  <  2Z  °j/d+  ®j)  * 


If  the  bound  is  <  1  ,  the  unique  distribution  attaining  equality  is 


?((1,  -Og,  -a?,***,  -0^)]  =  o^/(l+ 0^)  , 


?{(-o^  ,  1,-ij  ,  "..  ,  -c,^)]  =  Og,^!  +0?)  , 

?((-o^, -Ogj  •  •  •> -c."^  ,  1))  3  a.^/  ( 1  +  a?)  , 

-,//  2  2  2  2\.  ,  r— — .  2  •«,  2\ 

r{''°l'-°2'  ”*'"<Vl,'<V}  3  1  '  i+°J  * 


Uniqueness  follows  by  an  argument  similar  to  that  used  in  (1).  Ve  note  that 

2  2 

in  this  case  the  covariances  Tw..  x ,  *  -  <?  3  are  not  zero. 

i  J  *  u 
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An  alternative  proof  of  (4.2)  following  the  procedures  of  Section  1 

_2 

is  to  choose  3  =  1  in  (1.8)  and  nininite  tr  D,  (£  +  a' a)  vith  respect 

JL  ■*& 

2 

to  a  <  1  .  The  aininining  aj  =  • 


[1]  I.  Olkin  and  J.  V.  Pratt,  "A  xultivariate  Tehebycheff  inequality," 
Ann.  Math.  Stat.,  Vol.  29  (1955),  PP-  226-234. 

[2]  J.  V.  Uspensky,  Introduction  to  Mathematical  Probability,  McGraw  Hill 
New  York,  1937- 
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A  CUE-SIDED  AXALCC  CF  KOLMCGOK-X.VS 
by 

Albert  W.  Marshall! 


H.  °r.d  «aarf. 

Zz  is  -«aeil-3c:ova  (see  e.g.  [l]  p.  193)  ?imt  for  every  ■puiirive  £ 
-.test  s&zzy  itnatre  integrable  random  variable  >T.  with.  rero  esectaticn , 

?{X  >  £}  <  E(X2)/[€2  +  . 


js.  ‘v.  psper  an  inequality  is  obtained  thar.  .jpene  rallies  thir  in  the 
sscse  way  tnat  Xalrcgorov’s  inequality  generailiixes  Cbebyshev's  inequality. 
I fee  nneqixalll/  is  proved  in  Section  2  and  an.  *~«erole  is  give.  to  show 
tbnr  r^utlitv  can  be  achieved.  The  possibiLiit"  c:’  r-b-talninr  greater 
pnsnlitj  is  also  discussed.  In  Section  3  asr.  extension  tt  matir.tous 
imet.tr  nsrtingal.es  is  obtained,  and  a  ccniiition  order  wr_cn  equality 
rut  if  imitTfi  is  given. 


rrsuitv. 


Tntiren  2.11  Let  , . . . ,  be  ranatoa  variable  EX,)  =  1  , 

r  "  - X,  =  0  a.e. ,  1  =  2,3, . r  ,  *rd  £(X,  *  <  jd  , 

_  *  l.I , _ ,=  .  Then  :'or  every  positive  • 


max  v  +. 
KKs'T 


V 


7  •> 

t  Z. 


t  ^ 
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3 dire-  s  =  y  u, 

n  ti  1 


Proof:  Let  F(x)  =  F(x, ,x„,...,x_)  = 


(« 21  xi  +,sy)' 


i«i 


A  £  »* 


o  ot'~  »  :mdi  iet 
(  6“  +  S  )  : 

'  a: 


A.-  Xi  +  V"+  x<  <  e  ’  1  *  1,2,- •  -,k-i  ,  x1+x2, - +  X};>e) 


Z.  —  L,2,  •  ♦  •  ,n  .  Then 


'?  S.,dP  >'>~  [  ?(X)dP 
1=1  A. 


(c2  +  3n) 


21  /  i  X l  +  sn)2+2(e  Xi«»fl)(-fiSIx.)+«EIxt^dP 

k  3  )2  k=l  A ,  1=1  1  n  1=1  L*  *«ri.  *  i=k+l‘ 


? 

*5 


* 

$ 


J: - -  /  («  2ZX1+S^)2<ip  >  2~ P(A.  )  «  ?(f  -ana  fX+-“+X  )  >  e) 

%3  )2  k=l  A.  1=1  1  n  k=J  K  H<K~ 


(CS3J 


p 

Hsjcb  ,‘F(X)d?  »  a  /(€  +  sn)  .  the  proof  io  complete.. 

X  2 

To  show  that  equality  can  be  achieved  In  (2,1).  loot  s.  =  r,  , 

*  1=1  x 

s*  ,  and  let  Z  =  (Z^Zg,  •  •  *,Zn)  be  a  randoms  varmbie  saving  the 

*-  —loving  distribution: 


CT. 


TZ  -  <c,0, •••,(>)} 


TT  *1  ' 


I,  2  ?  2  2 

v~-m  — ,-a2  je  e'Jj.  *•*»■*«  ~ 2 


e2  or,2 


(cS3k^}(^  "  ^ 


—  -  V-O  *5  ... 


It  is  easily  verified  ay  induction  on  J)  that 


^  p  =  1  -  e2/(e2+ s  )  ,  j  =  1,2,  •••,(!  , 


so  that  this  is  ai  w&ijid  a  rob  ability  distribution.  Let  us  check  that  the: 
rar.doa  variables  !Zv)Z.„*'**,Zn  satisfy  the  conditions  of  Theorem  2.1  . 

Trivially  E(2L)  =  0-  Tor  1  <  J  <  n  ,  E(Zj  |ZJ;L  ±  -  cr^/c)  *  0  a.e'.. 

.  ,5)  , 

since  Zj  ^  jfc  -  dTj,  ,>(-£  implies  Zj  =  0  with  probability  one.  Using 
(2.2),  it  follows  rihtn.  E{ Z j | Z ^  ^  =  -  /e)  j„  a.e.  proportional  to 

M 

Pj(e2+  Sj ml)/e  -QL-'jtZ pk)Oj2/e  =  0  .  Hence  E(Zjlzj.i)  =  0  a.e., 

45s! 

and  it  is  clear  thiot  2(Z^|Zj  *  E(Zj  |Z,  ,Z.,,  •  •  •  ,Zj_^)  a.e.  Again 

using  (2.2),  it  ttxillxwr  that  E(ZjC)  *  P * ( €2  +  SJ -1  )^/ e<=  +  C1  '  > 

k=l 

J  »  1 ,2,  •  •  •  ,n  .  T?hus  *±e:'  random  variable  Z  satisfies  the  conditions  oil* 

Theorem  2.2;  furthisrmmsey  equality  holds  in  (i.l)  whenever  Xs(X.,Xg, . ,/X^.. - Z. 


It  is  natural!  ass'  to  ask  what  the  best  upper  bound  is  for 

P(  max  X^  -'■X, - +  X. )  >  1)  under  the  conditisns  of  Theorem  2.11 

1  <  i  <  r.  €1  “  * 

(where  >  0  ,  ‘do  U.r--’ ,  n)  .  Unfortunately  this  bound  has  no  simple 

expression  even  fan-  stall  n  ,  and  is  not  easily  obtained.  It  is  given  hi  ere 
only  for  n  »  2  .. 

Theorem  2.2:  let.  X  and  X,,  be  random  variables  with  E(X^)  =  0  ., 


S(X2}XL)  ^  0  a.e...,  s=£  SfX^i  =  s*  <  co  ,  1  -  1,£  .  Then  if  ^  >C 


a2  +Vi32'3l} 

?XL  -  £1  °r  X1  +  X2  -  €2J  -  2  2  ' 

a2  a2  ''1 


;  ai  =  <rZ  +  nL1t  ,  1  *  1,2,  and  ^  =  ain(«1,«2)  ,  \  *  «2 

Proof:  Sire  Ffx^)  -  ^  F^x^  +  c2  F£2(x1  **.)  vfcere 


\2 


2„  2 

ni  "2 


~  -  — o  -  5  5  2  >  “  2  2  ; 

-  a*  (“s  *  c2  al> 


^1 

Ft.x)  *  (x  +  —  )  > 


2  2 

<  a 

F2(x)  -  (x  +  +  -1t^)  ' 


and  4et  A,  -  ,  A2  -  ^  <  %  ,  ^  +  X?  >  .  Since 

30  >  >  0  „  it  iCllovs  that  cL  >0  ,  and 

/  F  (X1,X2:dP  *  ;  (c1F12(X1)  +  CgPg2^)  ♦  c2X2?2(:V  +  *2*2^* 

A1  ‘  *1 

>  ‘  {c,?,2(X,)w0Fo2(X,  ;]d?  >  /  (c.F.-:-,,  ;+c2F22(ni))d? 


/  F{X.,X„  a?  >  ;  c  r  2(X  ♦  X  )dP  >  /  c  ?22('.2:d?  a  ?(A2)  . 

A*  1  "  A  22  A2 


Thus  ;f(x:  _x..d?  >  ?{a1)4-p( a^  m  Ptxx  >  nL  or  x,  - x,  >  n2) 

>  P{X,  >  or  X,  +  X0  >  €-}  .  It  is  Jtraishtfor.-ard  to  verify  that 


-15- 


upcn  integrating  the  function  F(  X^,X'0)  ,  one  obtains  the  bound  given  in 
(2.3),  and  this  completes  the  proof. 

To  shoo  that  equality  can  be  achieved  in  ( 2 •  3) »  is-  "ave  t^ie 

following  Joint  distribution: 


?{(zvz2)  =  (^,0)}  :  aL7aL 


PKW  = 


2  2  2 
o,  a9  \  ao 

o)  -  (-  T~  >  T)]"  r~—  ’ 

7  'l  a^2  +a2 


„  2  „  2 

\  a2 


It  is  easily  verified  that  (Z^Z,)  satisfies-  the  conditions  of 


Theorem  2.2  .  Furthermore, 


2  2  2,  ,  \2 

a2  o,  -  0^  (02,0,) 

i^Z.,)  3  ( 1L,0) }  r  P'(Z1,Z2)  =  (-  ~  »  Y?  3  a2,‘-i  2  h  ) 

2  ‘  2  1 


r  Z,  +Z-  >  €,  ■*■  , 


?(Z^  >  or  Z^4-  Z0  >  V#  *  or  +i“2  ~ 


30  that  equeiity  holds  in  (2.3)  whenever  (X^C;  *  vZL>~2^  a,e' 

Several  Inequalities  follow  from  (2.3'  ’ispiy  -X  '-1  ^ar.ge  o:  variables. 
The  corollaries  below  are  giver,  to  illustrate  *he  p-ssUuiiiiie  .. 


Corollary  2.3:  le'- 


X  and  X.  be  random  variables  witr  3  a  , 


'■■a  , 
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S(X2|Xi)  =  bX^  +  c  a.e.(wfcere  b  /  -1)  and  VarlX^)  =  <  co  ,  i  =  1,2. 

Then  if  e^-  a  >0  and  [e2-6(a+  ab + e)]/|b  + l|  >0  where  5  =  3ign(b-t-l), 


(2.4) 


Pf'vl  -  ?1 


or 


Mx0+x2) 


a22-b2al2+ti2((b+l)Val]2 

»22-b2»l2K(b+1>2aa2/ai1 


where  =  cr^  +  ,  i  =  1,2,  and  ^  a  [e2-6(a  +  ab  +  c)  )/|b+l|  , 

\  *  min^-a,^)  . 

Proof:  This  follows  from  Theorem  2.2  by  making  the  change  of  variables 


X1  3  X1  +  a'  X2  *  bXl+  (b+1)X2+  ab+c>  ei  3  el  +  u’  e2  3  eolb+1l  + 6(a+ab+c) 
and  dropping  the  primes. 

Note  that  by  taking  a  =  b  =  c  =  0  in  this  corollary,  one  obtains 
Theorem  2.2  . 

Corollary  2.4;  Let  X,  and  X„  be  random  variables  such  that  E(X.)=u, 

i  1  L 

O 

Vur(X^)  a  j  ~  <  co  ,  i  a  1,2,  Cov(XpX2)  a  a^2  f  Q  ,  and  suppose  that  the 

regression  of  X,  on  X^  is  lir.eur.  Then  If  -  u,  >  0  and 
2 

u2)/«12  >0  where  5  a  sign  cr12  , 


(2.5) 


PlXj^  > 


or 


sx2  >  i2)  5 


alZ^la2Z-al?J  +al?*Vl2'a]/ 


X  X  i.  j-u.  u  X  w  L 


*>  ■  u. 


i 

,  -z y- 
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wt’.e re  ,  1  =  1,2,  and  n2  =  (8  V^lV^lS  ’ 

\  =  • 


Proof:  To  obtain  (2.p)  from  (2.3),  make  the  change  of  variables 


1  3  V*V  X2  =  [ori2(Xl  +  X2)/ffi21  +  m2  ’  €1  =  ei  +  i:l  ar‘d  £2  3  5(£2tri2+ai%) 


in  '2.3;  and  then  remove  the  primes. 


3-  An  extension  to  continuous  parameter  martingales. 

We  begin  by  assuming  that  the  underlying  probability  space  is  such  that  P 
Is  complete.  Then  we  have  the  following 


Theorem  3-1:  Let  (Y,.,  t  >  0)  be  a  separable  martingale  such  that  for 

p  p 

all  t  >0  ,  E(Yt)  a  0  and  E(Yfc  )  =  <r  (t)  <  oo  .  Then  for  every  positive 
€  and  t  , 


{3-D 


P  -j  sup  Y  >  4  <  -fi-p" 

Ue(0,t]  J  e2+(72(t) 


Proof:  Let  0  »  t.  <  t.  <  •••  <  t  *  t  .  Then  X,  -*  Y  and  X.  *-Y  -  Y  , 

- —  i  -  2  -  -  n  1  t,  i  t.  t. 

i  i  i  -  j. 


i  =  2,3; - • • ,n  satisfy  the  conditions  of  Theorem  2.1,  ~o  that 


(3-2) 


P  >?  max  Y,  >  €}■  <  <x2(t)/ie2  ta^r)) 
■1  <  i  <  n  '1  “  J  ~ 


-  «  •<  .  ■■  . 
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Let  S  be  a  countable  set  satisfying  the  definition  of  separability  and 
containing  the  points  0  and  t  .  Taking  the  supreaua  of  the  left  side 
of  (3.2)  over  all  finite  subsets  of  sn[0,t)  ,  we  obtain 


